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Abstract: We find the Bahadur slope of the Lilliefors and Cramer-von Mises 
tests of normality. 

1. Introduction 

The simplest goodness of fit testing problem is to test whether a random sample 
Xi, . . . , X n is from a particular c.d.f. Fq. The testing problem is: 

H :F = F , versus H 1 : F F Q . 

A common goodness of fit test is the Kolmogorov-Smirnov test (see Chapter 6 in [j| ; 
and Section 5.1 in [131]). The Kolmogorov-Smirnov test rejects the null hypothesis 
for large values of the statistic 

(1.1) sup|F n (t)-F (i)|, 

where F n (t) = n _1 -^(-^j < t) , t E R, is the empirical c.d.f. Another possible 

test is the Cramer-von Mises test, which is significative for large values of the 
statistic: 

/oo 
[F n (t) - F Q (t)} 2 dF (t). 
-OO 

Anderson and Darling [l[ generalize the previous test by adding a weight function 
and considering: 

/oo 
[F n (t) - F (t)} 2 iP{F (t))dF {t), 
-oo 

where ip is a (nonnegative) weight function. The asymptotic distribution of the 
statistics in (1.1)— (1.3) can be found in [2fj| . 

A natural definition of efficiency of tests was given by Bahadur 5, 6]. Let {/(•, 9) : 
9 E 0} be a family of p.d.f.'s on a measurable space (S,S) with respect to a 
measure fx, where is a Borel subset of R d . Let X\,..,,X n be i.i.d.r.v.'s with 
values in (S, S) and p.d.f. /(-,#), for some unknown value of 9 € 0. Let 0o C 6 
and let 6i := 9 — 0o- Consider the hypothesis testing problem H n : 9 € O versus 
Hi : 9 G 0i. The level (or significance level) of the test is 

sup Pg {reject Ho}. 
eee 
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The p-value of a test is the smallest significance level at which the null hypoth- 
esis can be rejected. Suppose that a test rejects Ho if T n > c, where T n := 
T n (X\, . . . , X n ) is a statistic and c is a constant. Then, the significance level of 
the test is 

(1.4) H n (c) := sup Pg(T n > c), 

0ee o 

where Pq denotes the probability measure for which the data has p.d.f. /(•, 6). The 
p-value of the test is 

(1.5) H n {T n ). 

Notice that the p-value is a r.v. whose distribution depends on n and on the specified 
value of the alternative hypothesis. Given two different tests, the one with smallest 
p-value under alternatives is preferred. Since the distribution of a p-value is difficult 
to calculate, Bahadur (1967, 1971) proposed to compare tests using the quantity 

(1.6) c(0i) := -21iminfn -1 lni? n (T„) a.s. 

n — >oo 

where the limit is found assuming that X±, . . . ,X n are i.i.d.r.v.'s from the p.d.f. 
f(-,0i), &i G ©i. The quantity c(8i) is called the Bahadur slope of the test. Given 
two tests, the one with the biggest Bahadur slo pe is preferred. For a review on 
Bahadur asymptotic optimality see and Nikitin [l6|. The Bahadur slopes of the 
tests in (1.1) and (1.2) can be found in Chapter 2 in [l6j |. 

For the statistic in (1.1), it is known (see [6j) that if F is a continuous c.d.f., 
then 

(1.7) lim n- 1 \nH n {T n ) = -G(sup \F(t) - F a {t)\) a.s. 

when the data comes from the c.d.f. F, F Fq, where 
(1.8) 

G(a)= inf ((a + 1) ln(t -1 (a + 1)) + (1 - a - 1) ln((l - i) _1 (l - a - t))) . 

< t < 1 — a 

In this paper, we will consider the Bahadur slopes of some tests of normality, i.e. 
given a random sample X%, . . . , X n from a c.d.f. F we would like to test: 

(1.9) Hq : F has a normal distribution, versus Hi : F does not, 

We would like to obtain results similar to the one in (1.7) for several tests of 
normality. Reviews of normality tests are 12 , 21 1 and [HI . 

Lillicfors 14] proposed the normality test which rejects the null hypothesis for 
large values of the statistic 

(1.10) sup|F„(X ra + s n i)-$(t)|, 

teR 

where $ is the c.d.f. of the standard normal distribution, X n :— n~ x Sj=i an< ^ 
:= (n — 1) _1 X)j=i {Xj — X n ) 2 . This test can be used because the distribution of 

(1.10) is location and scale invariant. We will consider the test of normality which 
rejects the null hypothesis if 

(1.11) sup \F n (X n + s n t) - $(t)|V>(t), 

teR 
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where ip : R — > [0, oo) be a bounded function. 

We also consider the test of normality which rejects normality if 

/oo 
[F n (X n + s n t) - W), 
-oo 

where ip : R — > [0, oo) satisfies ip(Fo(t))dFo(t) < oo. Notice that the statistics 
in (1.11) and (1.12) are location and scale invariant. 

In Section 2, we present bounds in the Bahadur slope for the statistics in (1.11) 
and (1.12). Our techniques are based on the (LDP) large deviation principle for 
empirical processes in @, d, 0| • We refer to the LDP to [l(| and [§] . The proofs are 
in Section 4. 

In Section 3, we present some simulations of the mean of the p-value for several 
test under different alternatives. The simulations show that Lilliefors test has a high 
p-value. However, the p-value of the Anderson Darling is competitive with other 
test of normality such as the Shapiro- Wilk test ([HI]) and the BHEP test ([ll[ and 

0)- 

2. Main results 

In this section we review some results on the LDP for empirical processes. We 
determine the rate function of the LDP of empirical processes using Orlicz spaces 
theory. A reference in Orlicz spaces is [l8j]. A function T : R — * R is said to be 
a Young function if it is convex, T(0) = 0; T(x) = T(— x) for each x > 0; and 
linxr^oo T(x) — oo. Let X be a r.v. with values in a measurable space (S, S). The 
Orlicz space C (S,S) (abbreviated to C T ) associated with the Young function T 
is the class of measurable functions / : (S,S) — > R such that E[T(Xf(X))] < oo 
for some A > 0. The Minkowski (or gauge) norm of the Orlicz space C (S, S) is 
defined as 

N r (f) = inf{A > : E[T(f(X)/X)} < 1}. 

It is well known that the vector space £ with the norm Nx is a Banach space. 
Define 

C Ta := {/ : S -> R : E[T Q {X\f(X)\)] < oo for some A > 0}, 

where T (a;) = el x l - \x\ - 1. Let (£ T »)* be the dual of (£ T °,iV To ). The function 
/ G jC t ° In (i£[e^W]) £ I is a convex lower semicontinuous function. The 
Fenchel-Legendre conjugate of the previous function is: 

(2.1) J(l) := sup (l(f) - In (e^])) , I £ (£ T »)*. 

J is a function with values in [0, oo]. Since J is a Fenchel-Legendre conjugate, it is 
a nonnegative convex lower semicontinuous function. If J(Z) < oo, then: 

(i) 1(1) = 1, where 1 denotes the function constantly 1. 

(ii) I is a nonnegative definite functional: if f(X) > a.s., then 1(f) > 0. 
Since the double Fenchel-Legendre transform of a convex lower semicontinuous 

function coincides with the original function (see e.g. Lemma 4.5.8 in [9(), we have 
that 



(2.2) 



sup (1(f)- J(l)) = In E[e^ x \ 
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The previous function J can be used to determine the rate function in the large 
deviations of statistics. Let {Xj}j°. 1 be a sequence of i.i.d.r.v.'s with the distribution 
of X. If fi,...J m e£ To , then 

satisfies the LDP in R m with speed n and rate function 



I(ux,...,u m ) := ^ sup ^ ( Ajiij - ln^[exp(^] Aj/j(X))] 



Ai,....A„ 



(see for example Corollary 6.1.16 in Q). This rate function can be written as 

inf { J{1) : I e (£ T °)*, l{fj) = u.j for each 1 < j < m] , 

(see Lemma 2.2 in Q). 

To deal with empirical processes, we will use the following theorem: 

Theorem 2.1 (Theorem 2.8 in Q). Suppose that sup tgT \f{X,t)\ < oo a.s. Then, 
the following sets of conditions ((a) and (b)) are equivalent: 

(a.l) (T,d) is totally bounded, where d(s,t) = E[\f(X, s) — f(X,t)\]. 

(a. 2) There exists a A > such that 

E[exp(XF(X))} < oo, 

where F(x) = sup tgT \f(x,t)\. 

(a. 3) For each A > 0, there exists a n > such that E[exp(XF^ (X))] < oo, 
where F^ix) = SUp d(Si4) <^ \f(x,s) - f(x,t)\. 

(a.4) sup^K^rUtX^) - E[f{X v t)])\ ^ 0. 

(b) {n~ 1 'Y^ =1 f{Xj,t) : t G T} satisfies the large deviation principle in loo(T) 
with speed n and a good rate. 

Besides, the rate function is 

I{z) = inf{J(/) : I e (C To )*,l(f(-,t)) = z(t), for each t£T},ze loo(T). 

We will consider large deviations when the r.v.'s have a standard normal distri- 
bution. We denote (Cj, , Ny ) to the Orlicz space, when the distribution of X is a 
standard normal one. Similarly, 



(2.3) 



Ml) := sup (l(f) - In (e^^})) , I S (£ T °)' 



First, we consider the Bahadur efficiency of the test in (1.11). Next lemma con- 
siders the large deviations of the test statistic in (1.11) under the null hypothesis. 
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Lemma 2.1. Let tp : R — > R be a bounded function. Then, for each u> 0, 
- inf { J$(l) : I £ (£j°)*,sup |x(a + (b - a 2 ) 1/2 t) - $(t)|V(*) > u, 

i(/ f )= I (t),feM,;( 9 ) = fl ,l( 9 2 ) = i ) , 

where / t (s) = J(s < t),g(s) = s,s £ m| 

< lim inf n -1 lnP$ <^ sup \F n (X n + s n t) - > u \ 

(2.4) " ™ \ 

< lira sup n^ 1 In P$ i sup \F n (X n + s n t) - $(t)\ip(t) > u \ 

n— >oo (tGR J 

< -inf(j*(0 :/£ (£j°)*,sup|a;(a + (fe-a 2 ) 1 ' /2 t)-$(t)|^(t) > u, 

L tGR 

l(f t ) =x(t),t £R,l(g) = a,l(g 2 ) = b, 
where f t {s) = I(s < t),g(s) = s,s £ r| 

Theorem 2.2. Lef V : K — > R &e a bounded function, let 

(2.5) := P$ (sup|F„(X„ + «„*) - > «j ,« > 0, 



tGR 



and Zet 



G Li (w) := inf j J*(0 : Z £ (£j°)*,sup |x(a + (6 - a 2 ) 1 / 2 *) - $(t)\ip(t) > u, 

L tGR 

l(f t ) = x(t),t£R, 1(g) = a, l(g 2 ) = b, 
where f t (s) = I(s < t),g(s) = s, s £ M} 

Let {Xj}°Z 1 be a sequence of i.i.d.r.v.'s with c.d.f. F. Then, 

- lim G Li ( sup \F(p F + a F t) -<5>(t)\ij(t) + 5) 
5 ^o+ \tm J 



< lim inf n" 1 hiP^ 1 sup |P„(X„ + s n t) - $(t)\ip(t) 

(2.6) rwo ° y eR 

< limsupn- 1 lnP^i ( sup \F n (X n + s n t) - $(t)|V(*) 



tGR 



<- lim G Li (sup|F(/i F + o- F i) - $(i)IV>(i) - $ J a.s. 

<5^0+ \tGR / 

w/iere /xp = Pf[-^] a^d op = Var F (X). 

For the statistic in (1.12), we have similar results: 
Lemma 2.2. Let ip : M — ► [0, oo) be a function such that tp(F (t))dF (t) < oo. 
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Then, for each u > 0, 
-infjj*(0 

/OO 
[a;(a + (b - a 2 ) 1/2 t) - $(t)] 2 ij(F (t))dF (t) > u, 
-OO 

l(f t ) = x(t),t£R, 1(g) = a, l(g 2 ) = b, 
where f t (s) = I(s < t),g(s) = s, s £ m| 

< liminf n- 1 InP* ( / [F„(X„ + * n i) - $(t)] 2 ^(F (t))dF (t) > u 1 

< limsupn- 1 InP* ( f [F n (X n + s n t) - <5>(t)] 2 i;(F Q (t))dF Q (t) > u\ 

n— >oo LJ-oo J 

<-inf|j $ (0:/G(4 )*, 

/OO 
[x(a + (6 - a 2 ) 1 / 2 * - 4>(t))] 2 i;(F Q (t))dF Q (t) > u, 
-OO 

l(f t ) = x(t),t£R, 1(g) = a, l(g 2 ) = b, 
where / t (s) = I(s < t),g(s) = s,s £ r| 

Theorem 2.3. Let ip : K — > [0, oo) &e a function such that J r iIj(x) dx < oo, let 

(2.8) H^(u):=P^{[ (F n (X n + s n t)-<5>(t)) 2 ^(<$>(t))d<5>(t)>u\ ,u>0, 



(2.7) 



and Zet 

G AD (u) :=mi{Ml):l£(£l°)*, 

/OO 
[x(a + (b - a 2 ) 1 / 2 *) - $(i)] 2 V(Fo(t))dF (t) > u, 

' i(/t) =*(*).* €R, «(5)=a, % 2 )=fc, 

where / t (s) = J(s < i),g(s) =s,sel}. 

Let {Xj}j^ 1 be a sequence of i.i.d.r.v.'s with a continuous c.d.f. F. Then, 



(2.10) 



- 5 lim + G AD (^j [F(n F + a F t) - $(t)] 2 ?/>($(t))d$(t) + S 

< liming 1 In AD [F n (X n + s n t)) - <5(t)] 2 ^(t))d^(t) > u 

< Mmsupn-HnH^ ( f [F n (X n + s n t) - $(t)] 2 ^($(t))d$(t) > u ) 

rwoc \J-oc / 

lim + G AD (^j [F(n F + a F t) - <S>(t)} 2 tP(<S>(t))d$(t) - sj a.s. 



< 

5- 



3. Simulations 



We present simulations of the mean of the p- value of several alternatives. As before, 
suppose that a test rejects H if T„ > c, where T n := T„(Xi, . . . , X„) is a statistic 
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and c is a constant. The significance level of the test is 

(3.1) H n {c) := sup P e (T n > c), 

see 

where Pg denotes the probability measure for which the data has p.d.f. /(•, 6). The 
p-value of the test is H n (T n ). We do simulations estimating E[H n (T n )]. 

Let , . . . , T^ 1 be N simulations of the test under the null hypothesis using a 
sample size n. Let T^' alt , . . . , T^' &lt be N simulations of the test under a certain al- 
ternative hypothesis. Then, N~ 2 E^k=i 7 ( T « > T n alt ) estimates E[H n (T n )}, where 
the expectation is taken assuming that T n is obtained using n i.i.d.r.v.s from the 
alternative hypothesis. In Table 1, N = 10000 is used for the Lilliefors, the Cramer- 
von Mises, the Anderson-Darling, the Shapiro- Wilk, and the BHEP test ([lH and 

0)- 

Table 1 

~n L CM AE> SW BHEP 



Alternative: exponential distribution 



10 


0.248325 


0.2065738 


0.1878327 


0. 


1621557 


0. 


.1813481 


15 


0.1601991 


0.1178508 


0.0946044 


0. 


07611985 


0. 


09569895 


20 


0.1043946 


0.06510648 


0.05291726 


0. 


03304067 


0. 


.05206452 


30 


0.044566 


0.02152872 


0.0129459 


0. 


.00750638 


0. 


.01409681 


50 


0.00818707 


0.00203949 


0.0009082 


0. 


.00241882 


0. 


.00121646 


Alternative: double exponential 


distribution 










10 


0.3992631 


0.3939724 


0.3983314 


0. 


.4148731 


0. 


.4109459 


15 


0.3499758 


0.339891 


0.3389608 


0. 


.3677549 


0. 


.3640368 


20 


0.3169975 


0.2979569 


0.3009778 


0. 


.3294354 


0. 


.3244178 


30 


0.2616672 


0.2341172 


0.2397223 


0. 


.2807123 


0. 


.2555247 


50 


0.1796492 


0.1417312 


0.1434135 


0. 


.2837385 


0. 


.1564005 


Alternative: Cauchy distribution 










10 


0.1566254 


0.1493284 


0.1500601 


0. 


.1705618 


0. 


.1682588 


15 


0.08474307 


0.07479607 


0.07505173 


0. 


.09128725 


0. 


.08964657 


20 


0.04651569 


0.03862244 


0.03767999 


0. 


.04857044 


0. 


.04194876 


30 


0.01420118 


0.0100633 


0.00974881 


0. 


.01496182 


0. 


.01179398 


50 


0.0017361 


0.00066862 


0.00087474 


0. 


.00405 





.00048095 


Alternative: Beta(2,l) distribution 










10 


0.41099 


0.3884071 


0.3686801 


0. 


.3358273 


0. 


.3565215 


15 


0.3608343 


0.321224 


0.2986805 


0. 


.2631936 


0. 


.2861669 


20 


0.3147082 


0.272089 


0.2446055 


0. 


.1861695 


0. 


.2330953 


30 


0.2411935 


0.1840438 


0.1534217 


0. 


.09638084 


0. 


.1428481 


50 


0.1355312 


0.08707787 


0.05502258 


0. 


.0835284 


0. 


.0572854 


Alternative: Beta(3,3) distribution 










10 


0.5084849 


0.5040435 


0.51387 


0. 


.4928259 


0. 


.4947155 


15 


0.5063525 


0.5029377 


0.5033103 


0. 


.4872658 


0. 


.4864098 


20 


0.5072011 


0.5037995 


0.4993457 


0. 


.4762998 


0. 


.4797991 


30 


0.4899722 


0.4745532 


0.4780857 


0. 


.4285843 





.4510982 


50 


0.4590308 


0.4447785 


0.4382911 


0. 


.4189339 





.4064414 
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Alternative: Logistic(l) distribution 






10 


0.4736219 


0.4725762 


0.4685902 


r\ a>7 AC\' m 7 A O 

0.4749748 


0.4677617 


15 


0.4560905 


0.4468502 


0.4335687 


C\ A f O A t~* A O 

0.4624648 


0.46532 


20 


0.4493409 


0.4488339 


0.4450634 


A A A Of 1 A A 1 

U.44zol)41 


0.4510982 


30 


0.4410423 


0.422886 


0.4233825 


U.4:04:0U/i4: 


U.^tlOOUUU 


50 


0.4204326 


0.3978938 


0.3770672 


0.4458524 


0.3819914 


Alternative: unifo 


rm distribution 






10 


0.4438842 


0.4241476 


0.404153 


0.3681328 


0.3922898 


15 


0.4059967 


0.3716177 


0.3468994 


0.3023148 


0.338187 


20 


0.3739766 


0.3308353 


0.2951247 


0.2270906 


0.27552 


30 


0.3050368 


0.2429758 


0.2024329 


0.117917 


0.1862224 


50 


0.2066687 


0.1359771 


0.0889871 


0.1007488 


0.08932786 



We should expect the average p-value is small than 0.5. However, for the 
Beta(3, 3) distribution the average p-value is bigger than 0.5. Between the tree 
test which use the empirical c.d.f., the Anderson-Darling test is the one with small- 
est average p-value. For almost half of the considered distributions, this is the test 
with the smallest average p-value. The Shapiro- Wilk test also performs very well 
overall. 



4. Proofs 

We will need the following lemmas: 

Lemma 4.1 (Lemma 5.1 (i), [4]). For each k > and each function f G C ° , 

\l(f)\<(J(l) + l + 2^)N To (f)- 

Lemma 4.2. Let I G (Cl )* with Ml) < oo. Then, x(t) = l(I(- < t)), t G R, 
continuous function with limt^—oo x(t) = and lim^oo x(t) = 1. 



Proof. Let a : (0, oo) — > (0, oo) be defined as a(x) — exp(l/x) — 1/x. It is easy to 
see that a is one-to-one function. We claim that for a Borel set A C R, 

(4.1) N To (I(X G A)) = a- l {l + (P*(X G A))- 1 ), 

where a -1 denotes the inverse function of a. We have that 

E^,[T (X- 1 I(X G A))} = E[exp(\- 1 I(X G A)) - 1 - X^ 1 I(X G A)] 
= pcxp(A- 1 ) + 1 -p-1 - A _1 p, 

where p := P$(X G A). So, 1 > S tt ,[T (A" 1 /(A G A))] is equivalent to a(X) < 
1+p- 1 . So, (4.1) follows. 

By Lemma 4.1 and (4.1), for each s,t G R with s < t, 

\ x (t)\ = \i(i(x <t)\< (Mi) + 1 + 2 i />- i (i + (mr 1 ), 
ii - x(t)\ = \i((x > m < (Mi) + 1 + 2 i ' 2 )a- i (\ + (i - mr 1 ), 

and 

\x(t) - x(s)\ < (Ml) + 1 + 2 1 />- 1 (l + - ^(s))- 1 ), 

which implies the claim. □ 
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Proof of Lemma 2.1. By Theorem 2.1, {U n (t) : t £ R} satisfies the LDP in ^(R) 
with speed n, where U n {t) — F n (t). Let u>\ and oj 2 be two numbers, which are not 
in R. Let U n ((Ji) = ti -1 £" =1 -ST,- and let U n {uj 2 ) = n -1 £*=i By the LDP 
for sums of i.i.d. Revalued r.v.'s, the finite dimensional distributions of {U n (t) : 
t £ R U {uji,oj2}} satisfy the LDP with speed n. Since {U n (t) : t £ R} satisfies 
the LDP in ^(R), it satisfies an exponential asymptotic equicontinuity condition 
(see Theorem 3.1 in 0]). This implies that {U n (t) : t £ RU {uji,uj 2 }} satisfies 
an exponential asymptotic equicontinuity condition. So, {U n (t) : t £ R U {wi,^}} 
satisfies the LDP in ^(RUjcJi,^}) with speed n (see Theorem 3.1 in |2j). Besides, 
the rate of function is 

I(x) =inf{J$(/) : I e (C r «)*,l(I(X <t) = x(t),t £ R,l(X) = x{u) X ), 
l(x 2 ) = x(uj 2 ),xe loofiu^i,^})} 

Let T„ : Zoo(RU {wi,w 2 }) -> R be defined by 

r„(a;) = sup \x{x(u x ) + n 1 ' 2 ^ - l)- l ' 2 (x{u 2 ) - (x^ff/H) - $(t)|V>(t), 
teR 

for x £ 2oo(R U {wi,oj2})- Next, we prove using Theorem 2.1 in Arcones (2003a) 
that 

r n ({U n (t) :t£RU wa}}) = sup + s n t) - $(i)|V(t) 

teR 

satisfies the LDP in R with speed n and rate function 

q Li {u) :=inf{J«(l) : Z £ (£ T °)*, sup |a?(o + (6 - a 2 ) 1/2 t) - = «, 

(4 2 s ) * eR 

v ' 7 /(/(X < i)) = ac(i), t £ R, /(X) = a, 1{X 2 ) = b}. 

To apply Theorem 2.1 in we need to prove that if x n — > x, in Zoo(R U {u>i, lu 2 }) 
and I(x) < 00, then T n (x n ) — > T(x), where 

T(x) = sup Ixixiuj^ + (x(to 2 ) - {x^ff'H) - §{t)\i>{t),x £ l^QlUiwuUi}). 
teR 

We have that 

|l„(x„) - r(x)| 

< sup \x n {x n {ux) + n x ' 2 (n - l)-^ 2 (x n (uj 2 ) - (^(wi)) 2 ) 1 / 2 *)^*) 
teR 

- x{ Xn {^) + nV2( n _ i)-V2 (Xri(w2) _ {x^yy/H)^ 

+ sup {xixnfa) + n 1/2 (n - l)" 1 /^^) - (x^)) 2 ) 1 ' 2 ^) 
teR 

- + (x(cj 2 ) - ^(Wi)) 2 ) 1 / 2 *)^^)! 
=:I + II. 

Since x n — > x, in ^(R U {u>i, uj 2 }), 

I = sup teR \x n (t) - x(t)\ip(t) -> 0. 

By Lemma 4.2, a; is a continuous function with lim i _ > _ o0 x(t) = and lim^^ x(t) = 
1. So, 

77 -> 0. 

From the previous computations, we get that r n (a;„) —* L(x). Hence, sup 4gK \F n x 
(X„ + s n t) — 3>(i)| satisfies the LDP in R with speed n and rate function <? Ll (w). 
This implies (2.4). □ 
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Proof of Theorem 2.2. We have that 

sup \F n (X n + s n t)) - $(t)\ip(t) - sup \F(jl F + VFt) - *(t)M*)l 

teR teR 

< sup \F n (X n + s n t) - F(fi F + o- F t)\ 

teR 

< sup \F n {t) ~ F(t)\if)(t) + sup \F(X n + s n t)) - F((j,p + a F t)\i/)(t)\. 

teR teR 

By the Glivenko-Cantelli theorem, 

sup\F n (t)-F(t)\ip(t)^yQ a.s. 

Using that 

X n — > /i F a.s.,s n — > o F a.s. 

and F is a continuous function with hmi_ > _ o F(t) = and limt-xxs F(t) — 1, we 
get that 

sup \F(X n + s n t) - F(n F + a F t)\ip(t) -> a.s. 
teR 

Hence, 

(4.3) sup \F n (X n + s n t) - ®{t)\<ip{t) -> sup \F(fi F + apt) -${t)\ip(t)\ a.s. 

teR teR 

The claim in this theorem follows from (4.3) and Lemma 2.1. □ 

The proofs of Lemma 2.2 and Theorem 2.3 are similar to those of Lemma 2.1 
and Theorem 2.2 and they are omitted. 
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